Motion capture data retrieval using an artist's doll

In this paper, we present a keyframe-based human motion capture data retrieval system which uses a wooden doll as the input device. A user inputs a keyframe by posing an artist’s doll with painted joints in front of a stereo camera rig. The system interactively gives real-time feedback on the results of the joint detection and 3D pose reconstruction as the user is positioning and rotating the doll. The robust 3D joint reconstruction is achieved by integrating 3D joint positions from multiple views of the same pose. After the user has finished inputting all the keyframes, the motion sequences are retrieved from the database and ranked based on their similarities to the keyframes. Experiments show that the presented system is simple to use and has high quality of retrieval results.